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PREFACE 


This  Memorandum  is  part  of  RAND's  continuing  effort 
in  the  application  of  network  flow  theory.  It  provides 
a  graphic  description  of  the  out-of-kilter  algorithm, 
together  with  useful  computational  methods.  Network 
flow  problems  arise  in  the  solution  of  transportation 
and  scheduling  problems.  This  work  is  directed  toward 
the  user  and  programmer  of  network- solving  algorithms. 

Portions  of  this  material  were  presented  at  the 
SHARE  XXIX  meeting,  August  1967. 
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SUHMARY 

Network  flow  problems  arise  In  the  solution  of  trans¬ 
portation  and  scheduling  problems.  Divided  into  four 
substantially  Independent  sections,  this  Memorandum: 

1)  reviews  the  types  of  problems  that  are  representable 
as  capacitated  network  problems;  2)  explains  (with 
diagrams)  the  out-of-kilter  algorithm  and  techniques  for 
implementing  it  on  a  comput  rj  3)  describes  modification 
of  the  algorithm  to  a  two-phase  algorithm;  4)  presents 
a  method  for  labeling  the  nodes  by  means  of  a  scan  list. 
Tentative  conclusions  are  that  the  two-phase  algorithm 
is  undesirable,  and  that  the  labeling  procedure  shortens 
computer  time  at  the  cost  of  using  more  memory. 


/ 
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SYMBOLS 


The  subscript  notation  is  equivalent  to  parentheses 
or  brackets ;  e.g.  ,  Sj  S(j)  -  S C J  7 . 
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Incidence  matrix. 

Node  flow. 

Unit  cost. 

Reduced  cost. 

Total  cost,  as  a  function  of  flow,  in  one  arc. 
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Number  of  nodes. 

Number  of  arcs. 

Position  of  scanner. 


-xii- 


* 


Q 

R 
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Infeasibility  number. 

Total  ^feasibility. 

Scan  list. 

Reference  node. 

Length  of  scan  list. 

Source  node . 

Sink  node. 

Upper  capacity. 

Source  node  reference  list. 

Sink  node  reference  list. 

Amount  of  flow. 

Alternate  designation  of  flow. 

Special  reduced  cost. 

Objective  value. 

Dual  slack  variable. 

Node  price,  pi ( t)  is  used  in  ALGOL  programs. 
Temporary  symbol  for  constructing  the  g^  list 
Temporary  symbol  for  constructing  the  U^  list 
Temporary  symbol  for  constructing  the  list 


I.  INTRODUCTION 


THE  CAPACITATED  NETWORK  PROBLEM 

A  network  Is  made  up  of  a  set  of  nodes  together  with 
a  set  of  directed  arcs .  Figure  1  is  an  example  of  a  net¬ 
work  with  five  nodes  and  eight  arcs.  The  nodes  are  desig¬ 
nated  by  the  letters  A,  B,  C,  D,  and  E,  and  directed  arcs 


Fig.  1--Example  Network 

are  numbered  1,  2,  3,  A,  5,  6,  7,  and  8.  An  alternative 
way  of  designating  these  arcs  is  by  ordered  pairs  of  nodes 
hence,  arc  1  is  also  arc  (A,B) ,  arc  2  is  arc  (B,C),  arc  3 
is  arc  (C,B),  etc.  The  first  node  of  the  ordered  pair, 
called  the  source  node,  is  the  node  from  which  the  indi¬ 


cated  arrow  is  directed;  the  second  node,  called  the 


2 


* 


s ink  node,  Is  the  node  toward  which  the  arrow  is  directed. 
Note  that  arcs  5  and  6  are  both  designated  as  arc  (D,E), 
so  that  a  subscript  on  the  ordered  pair  of  nodes  must  be 
used  to  distinguish  between  non-unique  ordered  pairs. 
Hence,  arc  5  is  arc  (D.E^  and  arc  6  is  arc  (D,E>2.  Also, 
the  set  of  arcs  is  non-exhaust ive :  e.g.,  there  is  no  nrc 
(C,D)  or  (D,C)  in  Fig.  1. 


The  capacitated  network  problem  consists  of  a  network, 

together  with  the  following  four  quantities  for  each  arc  j : 

1)  0^ :  The  cost  of  sending  one  unit  of  flow  along 

arc  j  from  its  source  node  to  its  sink  node. 


2)  Uj :  The  upper  capacity  of  arc  j. 

3)  l 

j:  The  lower  capacity  of  arc  j. 

4)  The  nominal  flow  along  arc  j. 

Denoting  the  number  of  nodes  in  the  network  as  m  and 


the  number  of  arcs  as  n,  the  nominal  flows, 
the  node  constraints 


determine 


n 


Here 


-3 


a 


ij 


f  +1  if  node  i  is  the  source  node 
for  arc  j ; 

<  -1  if  node  i  is  the  sink  node 

for  arc  j ; 

'  0  otherwise. 


And  is  found  by  evaluating 


I 

j-1 


0 

a.  .  x. 

ij  j 


i~l  ,2  , .  .  .  ,m  . 


Note  that  each  column  of  the  (a..)  matrix  has  only  two 

ij 

non-zero  entries:  +1  and  -1.  Since 


m 


1-1 


n 


a  0 


) 


at  least  one  node  constraint  io  edundant.  Specifying 

a  nominal  flow,  x^,  uniquely  determines  b^ ,b^ , . . . ,bm , 

such  that  b,  +  b„  +. . .+  b  -  0.  A  nominal  solution  is 
l  l  m 

any  vector  (x^ ^ . ,x  )  that  satisfies 


n 


)  a-i  •  x. 

^  ij  J 


b. 

l 


i*i,2  , .  .  .  ,m 
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A  feasible  solution  of  the  capacitated  network  problem 
is  any  vector  (x^ > • • • «xn) <  such  that 

n 

1)  2,  aij  xj  “  ,2  , . .  .  ,m 

i-1 

2)  Xj  *  tj  j“l  .2 , . .  .  ,n 

3)  s  Uj  j-l,2,...,n  ; 

that  is,  a  feasible  solution  is  a  nominal  solution  that 
satisfies  l,  s;  x,  *  u.  for  all  arcs  j  .  If  there  is  at 

j  j  j 

least  one  feasible  solution  to  the  problem,  then  an  optimal 
solution  is  a  feasible  solution  that  minimizes 

n 

A)  *  m  lC j  Xj  ’ 

j-1 

where  $  is  called  the  objective  value.  That  is,  a 
feasible  solution  (y^ ,Y2 • • • • >yn)  is  optimal  if 

n  n 

l  °j  yi  s  l  cj 
j-1  J-l 

for  all  feasible  solution  vectors  (x^ ,X2 , . . . ,x  ) . 
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If  b^  is  zero,  node  i  is  said  to  be 


The  quantity  b^,  called  the  node  i  flow,  is  the  net 
flow  out  of  node  i. 
conservative .  If  all  nodes  are  conservative,  then  the 
zero  vector  is  a  nominal  solution,  and  the  ne twork  is 
conservative.  The  algorithm  for  solving  the  capacitated 
network  problem  requires  a  nominal  solution  rather  than 
a  set  of  node  flows.  A  simple  method  of  determining  a 
nominal  solution  is  to  make  the  network  conservative.  This 
is  done  by  adjoining  one  more  node,  called  the  supernode . 
to  the  network,  together  with  an  arc  from  each  node  that 
is  not  conservative  to  the  supernode.  The  lower  capacity 
and  upper  capacity  of  each  additional  arc  are  both  set 
equal  to  the  net  flow  out  of  the  node.  The  zero  vector 
is  then  a  nominal  solution  for  this  augmented  network. 

Note  that  there  are  no  sign  restrictions  on  any  of 
the  quantities  ,  u.  ,  i.y  x^,  Xj  or  b^.  However,  the 
problem  is  trivially  infeasible  if  u^  <  . 

A  simple  capacitated  network  is  a  capacitated  network 
with  lower  capacities  ( l of  zero.  A  general  network  may 
be  translated  to  make  it  simple.  Let 


Uj  "  UJ 


* 
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-0  0 
xj  ‘  xj  '  li 


x  «  x,  -  t, 
j  j  i 


for  all  j.  The  node  constraints  above  were 


n 


I-u  -  I 

J-l  J-l 


*o  xi 


l.™!. ,  2  ,  .  .  »  ,  rn  | 


where  the  right  slde9  to  these  equations  are  the  constants 


- 1 


j-i 


“ij  *J 


i-1 ,2 , . . .  ,m  . 


Substituting  the  above  quantities  having  a  diacritic 
tilde  into  the  node  constraints,  capacity  inequalities  and 
the  objective  function  results  in 


n 

n 

1) 

+  v  - 

l‘utf  +  V 

i»l,2 , . . ,  ,m 

j-i 

j-i 

2) 

VV 

j-1,2,. . . ,n 

‘j +  li  ‘  uj  + 


n 


3) 


j-1,2,.... 
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Other  linear,  and  some  non-linear,  network  and  trans¬ 
portation  problems  are  representable  as  capacitated  net- 

•fa 

work  problems  [1].  The  classical  transportation  problem 
involves  a  network  whose  nodes  are  divided  into  two  classes: 
source  nodes  and  destination  nodes.  If  there  are  jj  source 
nodes  and  d^  destination  nodes,  then  there  are  sd  directed 
arcs;  one  arc  from  each  source  node  to  each  destination 
node.  These  arcs  are  uncapacitated .  which  means  that 
■  0  and  Uj  ■  +»  for  each  arc  j .  Each  source  node  has 
a  net  flow  out  of  it,  called  the  supply;  and  each  destina¬ 
tion  node  has  a  net  flow  into  it,  called  the  demand .  Each 
arc  has  a  unit  cost  which  is  the  same  as  above.  This 
problem  may  be  solved  as  a  capacitated  network  problem 
by  making  the  upper  capacities  very  large,  although  special 
algorithms  are  available  that  solve  specifically  this  prob¬ 
lem.  The  capacitated  transportation  problem  is  as  above, 
except  that  (some  of)  the  upper  capacities  are  not  in¬ 
finite.  If  an  upper  capacity  is  zero,  the  corresponding 
arc  need  not  be  included  when  solving  the  capacitated 
transportation  problem  as  a  capacitated  network  problem. 

★ 

See  also  Ref.  2,  Chap.  14. 
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The  capacitated  network  algorithm  will  3olve  problems 
with  non-lincar  cost  functions  if  the  unit  cost  function 
for  a  given  arc  is  piecewise  constant  and  monotone  increasing 
(non-dccreasing) .  Let 


d  (x)  **  Je(x)dx  , 


where  c(x)  is  the  unit  cost  function,  and  d(x)  is  the  total 
cost  as  a  function  of  the  flow  x.  Then  d(x)  must  be  piece- 
wise  linear  and  convex.  If  the  co3t  function  has  r  "pieces"- 


^  A  »  *2  » 

X2  <  X  S  Xj  , 


i  » 

c(x)  -  cx  , 

d(x) 

-  CjX  +  Cq 

1  * 

c(x)  -  c2  , 

d(x) 

-  +  c2(x-xl) 

3  » 

c(x)  -  c3  , 

• 

d(x) 

-  d(x2)  +  c3(x-x2) 

;  xr  > 

• 

c(x)  -  cr  , 

d(x) 

• 

• 

-  d(xr_i)  +  cr(x“x 

where  cn  is  arbitrary  and 


c,  ^  C2  ^  c3  ^ ^  cr  , 


--then  this  arc  is  represented  by  r  parallel  arcs  (having 
the  same  source  node  and  sink  node)  with 
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U1  *  X1 


U2  ‘  x2 


u3  "  x3 


ur  -  xr 


and  unit  coses  c]/c2 »c3 > * ■ • *cr  *nd  nominal  flows  such 


Chat 


r  0 

L  X1 


is  the  nominal  flow  for  the  composite  arc.  The  answer 
(optimum  flow)  for  the  composite  arc  is 


I*i  • 


This  representation  of  the  composite  arc  is  not  unique, 
as  can  be  seen  from  the  converse.  Suppose  that  there  are 
r  parallel  arcs  with  lower  capacities  « »4r »  uPPer 

capacities  , . . .  ,ur ;  unit  costs  c^^ . c^  with 


11 


Cj  <  c 2  *•••*  c^;  and  nominal  flows  x^.x^ , • - ► ,xjj.  Then 
these  r  arcs  are  equivalent  to  the  arc  with  the  following 
composite  unit  cost: 


f  f 

C1 

:  *1 

4 

l2 

4.  .  .4 

t  *  x 

s  + 

*2 

+  .  .  .  + 

c2 

!  U1 

4 

l2 

4.  .  .4 

l  <  X 

r 

<  4 

u2 

4  /j  4.. .4  ^ 

C(x)  -  ( 


i-1  r  i  r 

ct  l  uj + 1  lj  ‘  5 l  uj +  llj 

1  i  1  i+1 


c  :  u,  4  u»  4. . ,4  u  .  4  t  <  x  s  u.  4  u„  4. . . 4  u 
x  i  L  r-ir  l  z  r 


with  lower  capacity 


l  l)  ’ 

j-i 

upper  capacity 


l  uj  ■ 

j-1 
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and  nominal  flow 

r 


J«1 


Thus,  for  example,  Che  composite  arc  whose  total  cost  is 
the  absolute  value  of  the  flow  has  composite  unit  cost 

-l  :  -u  s  x  s  0 
c(x)  -  <  ; 

+1  ;  0  <'  x  <  u 

and  if  the  lower  bound  is  the  negative  of  the  upper  bound 
u  and  the  nominal  flow  is  x®,  then  this  arc  is  equivalent 
to  the  two  parallel  arcs  with: 

■  -u  +  Or  U^-er  “  “1  x^«/9 

^2  ■  “Or  Ug  **  u  -  a  C2  *  +1  ■  x^  -  /3 

where  a  and  0  are  arbitrary.  Although  a  and  0  are  arbi¬ 
trary  as  far  as  the  optimal  flow  (x^  +  X2)  is  concerned 
(if  unique) ,  the  value  for  0  may  affect  the  speed  of 
solution;  while  if  a  is  not  zero,  the  objective  function 
($)  is  decreased  by  the  constant  2a. 
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A  (simple)  arc  can  be  reversed  in  direction  by 
changing  the  signs  of  its  unit  cost  and  nominal  flow  and 
reversing  the  upper  and  lower  capacities  and  changing 
their  signs.  Denoting  a  direction  reversal  by  a  circumflex, 
this  transformation  is 


l  -  -u 


u  -  -l 


c  -  -c 


0 


-*°  . 


Returning  to  the  capacitated  network  problem  in  its 
translated  form  (zero  lower  capacities) — 


n 


11  l  “y  xj  •  bi 
j-i 


i-1 ,2  , . .  .  ,tn 


2)  0  ,  Xj  ,  Uj 


j-1,2, . . . ,n 


3)  minimize  £  Xj 

J-l 
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--this  problem  may  be  stated  as  a  primal  linea::  programming 
problem  by  defining  n  slack  variables  x  . *xn42 ’ ' * ' ,x2n’ 

The  linear  programming  problem  is  then: 


minimize  ^  x^  with  »x2 » • ■ • >x2n  non-negative,  subject  to 

j-1 


iaijXj"bi  1-1 ’2 . " 

j-1 


Xj  +  Xn+j  “  UJ 


J  —1 ,2 ,  •  i  •  ,n  ■ 


Associated  with  the  linear  programming  problem  solution  is 
a  set  of  shadow  prices  (the  negative  of  the  dual  variables) 
,ir2 *  *  •  *  ,trm*  ^1  *^2  *  ‘  *  *  »^n*  A  necessary  condition  for 
optimality  is  that  there  exist  shadow  prices  such  that 


Cj  +  Z  aij  57 i  +  Xj 


j— 1  »2  i  •  •  •  ,n 


xi  1 0 
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m 

Setting  Cj  -  ^  a^j 

i*l 


Moreover,  if  (j  £  n)  is  positive  (then  variable  j  is 
basic),  the  equality  holds: 


VV°’ 

i.e. ,  Cj  *  0  ; 

and  if  x^^  is  positive  (i.e.,  <  u.),  then 


i.e.,  Cj  *  0  . 


Hence,  if 


* 
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0  <  Xj  <  uj: 


Cj  -  0  . 


The  quantities  rr^.ir ^ . ffm  are  the  node  prices . 

The  quantities  are  t*U!  marg*-nal  or  reduced 

costs .  Since  only  two  of  the  quantities  a^ * • • • »amj 
are  non-zero--in  particular,  if  i  is  the  source  node  for 
arc  j,  then  ■  +1;  and  if  k  is  the  sink  node  for  ^rc  j, 


then 


*  ■ 


c3  *  cj  +  *i  '  "k 


or  in  a  double  subscripted  arc  notation: 


cik  ■  cik  +  »i  -  \ 


The  implications 


c 


j 


£  0 


c.  •  0 
J 


if  Xj  >  0 


if  Xj  <  Uj 
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are  also  sufficient  conditions  for  x^,X2»...lxn  being  an 
optimal  solution  since 

n 

t- 

♦  -  )  c.  x. 

L  j  j 

j-1 

n  m 

■  I  sj  -  I  *1  aij 

j-1  i-1 

n  m  n 

■  1 xi  •  l\  l  au  xj 

j-1  i-1  j-1 

n  m 

-  I  *j  xj  *  I  "i  bi 

j-1  i-1 

cannot  be  decreased  by  making  a  feasible  change  in  the 
flow  (Xj).  That  is,  a  feasible  solution  (x^,X2 , . . . ,xn) 
has  minimum  ♦  if  there  exist  shadow  prices  » •  •  •  >ffm) 

such  that  Xj  >  0  implies  Cj  s  0  and  <  u^  implies  »  0. 


II,  THE  OUT-OF-KILTER  ALGORITHM 


The  method  described  here  is  similar  to  that  set  forth 
in  Ref.  3.  For  each  arc,  j,  let  S[j]  be  its  source  node 
and  T[j]  its  sink  node.  Each  node,  i,  has  a  price,  s(i) 
or  tr^.  The  reduced  cost,  c^  ,  of  arc  j,  is  related  to  its 
unit  cost ,  c j ,  by 

Cj  -  Cj  +  ff(S[j])  -  it (Ttj  ])  . 

A  set  of  flows  x^,X2»...,xn  in  the  arcs  is  called  a  nominal 
solution  if 


n 


l*ij 

xi  'bi 

i"l  y  •  a  •  ,in 

J-l 

where  the  (a^)  matrix  is 

such  that  for  each  arc  j  , 

'+i  if 

i  -  S[j] 

•u  '  < 

-i  « 

i  -  T[J3 

[  0  otherwise 

and  the  b^  are  integers,  known  as  the  node  flows.  A 
nominal  solution  is  a  feasible  solution  if,  in  addition  to 
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Wuj  1-1 -2 . n  (2) 

where  end  ere  given  integers .  is  known  es  the 
lower  cepeclty,  end  u^  is  known  es  the  upper  cepecity.  A 
feasible  solution  is  en  optimal  solution  if 

n 

♦  -  l  «j  *J 

J-i 

is  e  minimum  over  all  feasible  solutions.  A  necessary 
end  sufficient  condition  that  a  feasible  solution  be 
optimal  is  that  there  exist  ,1^ , . . .  ,ir  such  that  the 
Cj  calculated  from  these  satisfy: 


For  any  set  of  nominal  and  any  ir^,  let  k^  be  the 
kilter  number  of  arc  j,  defined  as  follows: 

This  differs  from  the  kilter  number  defined  in 
Ref.  3. 


t 


|x^  -  |  i£  Cj  <  0 


kj  -  ^  max  (0,  -  u^  ,  4^  -  x^)  if  »  0 


| Xj  -  -t j  |  if  Cj  >  0  , 


or  equivalently, 

kj  -  max(0 ,  x^  -  u^  ,  4^  -  Xy  8gn(Cj)<Xj  -  4^)  ,  agn(Cj)(Xj  -  Uj)) 

By  comparing  k^  with  Eqs.  (2)  and  (3),  it  can  be  seen  that 
every  k^  is  zero  only  if  the  solution  is  optimal.  The  value 
of  kj ,  never  negative,  is  the  amount  that  arc  j  is  "out-of¬ 
kilter."  The  amount  that  the  problem  is  "out-of-kilter"  is 


■ 

j-1 


The  network  problem  could  thus  be  stated  as  the  problem  of 
finding  tr^  and  nominal  x^  such  that  K  is  a  minimum.  Let 
Kq  be  the  minimum  such  K.  If  Kq  is  zero  (i.e.,  the  problem 
is  feasible) ,  it  is  possible  to  reduce  each  kj  to  zero  with¬ 
out  increasing  any  of  the  other  kilter  numbers  in  the  process. 
If  the  problem  is  infeasible  (Kq  f  0),  the  algorithm  described 
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in  this  section  may  not  attain  K  «■  Kq,  because  if  Kg  >  0 
,%  lower  value  or  K  is  sometimes  attainable  only  at  the 
expense  of  increasing  the  kilter  numbers  of  some  arcs. 

In  order  to  attain  K  -  Kq,  it  is  (sometimes)  necessary  to 
use  a  "two-phase"  algorithm  for  which  the  second  phase  is 
given  here.  The  first  phase  of  this  "two-phaseH  algorithm 
is  discussed  in  Sec.  XII.  For  most  purposes „  the  algorithm 
described  in  this  section  is  sufficient,  since  one  usually 
deals  with  a  feasible  problem  or  a  problem  with  obvious  in- 
feasibllitles . 

The  algorithm  fer  solving  a  network  problem  begins 
with  any  node  prices  and  any  nominal  solution,  then  proceeds 
as  follows.  An  arc  is  found  with  a  non-zero  kilter  number. 
Then  a  labeling  procedure  is  initiated  that  attempts  to 
find  a  cycle  of  arcs  along  which  at  least  one  unit  of  flow 
can  be  pushed  without  increasing  the  kilter  numbers  In  any 
arc  in  the  cycle.  If  such  a  cycle  is  found,  the  indicated 
flow  change  is  made,  thus  decreasing  the  kilter  number  of 
«t  least  one  arc.  If  no  cycle  is  found,  a  change  in  the 
node  prices  is  made,  such  that  the  labeling  procedure  now 
will  result  in  more  nodes  being  labeled.  When  no  more 
progress  with  a  particular  arc  can  be  made,  the  algorithm 
looks  for  another  out-of-kilter  arc.  When  all  arcs  are 
either  in-kilter  or  in  a  condition  such  that  no  improvement 
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in  the  kilter  number  can  be  made,  the  algorithm  terminates. 
Convergence  of  the  algorithm  is  proved  by  showing  that  the 
number  of  consecutive  labeling  procedures  that  can  be 
attempted  without  decreasing  the  total  kilter  number  is 
bounded. 

For  example,  arcs  5,  4,  3,  and  7  in  Fig.  1  form  a 
cycle,  with  arc  7  traversed  backwards.  To  indicate  that 
arc  7  Is  traversed  backwards,  it  will  be  denoted  as  arc  -7. 
Thus,  the  above  cycle  is  5,  4,  3,  -7.  In  order  to  define 
a  cycle  in  algebraic  terms,  let  be  numbers 

such  that 


f  +1 


if  arc  j  is  traversed  forward 
if  arc  j  is  traversed  backward 
if  arc  j  is  not  traversed  . 


Then  these  arcs  which  are  traversed  form  a  cycle  if 
n 

£  a^ j  e j  ■  0  i-1 , 2 , . . .  ,m  . 

J-l 


Moreover,  this  cycle  is  a  simple  cycle  if  no  node  appears 


as  either  a  source  node  or  a  sink  node  on  any  arc  in  the 
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cycle  more  Chen  twice,  i.e.  ,  if 


n 

£  |4u  “j1  5  2  l“1,2 . m  ■ 

i-i 


Thus,  it  cen  be  seen  theC  any  amount  of  flow  may  be  pushed 
through  a  cycle  without  changing  the  node  constraints. 

That  is,  nominality  o>  the  flow  is  preserved  by  replacing 
Xj  by  Xj  +  Me^  for  all  J  and  M  any  constant. 

For  Fig.  1  the  (*y)  matrix  has  the  form 


A 


1  0 

-1  1 

0  -1 

0  0 

0  0 


0  0 

-1  0 

1  -1 

0  0 

0  1 


0  0 

0  0 

0  0 

1  1 

-1  -1 


0  -1 

-1  0 

0  0 

l  1 

0  0 


node  A 
node  B 
node  C 
node  D 
node  E 


and  for  the  above  example  the  e^'s  are  0,  0,  l,  1,  1,  0,  -1, 
and  0. 

For  any  arc  j ,  we  may  denote  its  position  in  a  state 
diagram  (assuming  u^  >  Figure  2  shows  the  15  possible 

combinations  of  x^  and  in  relation  to  the  capacities. 

*A  simple  cycle  may  also  be  defined  as  a  minimal 
dependent  set  of  columns  of  A. 


c  o 

c  **  0 

c  >  0 

X  >  u 

X  >  u 

X  >  u 

<cr5) 

OS) 

(y5) 

c  <  0 

c  ■  0 

c  >  0 

x  -  u 

x  *  u 

X  •  u 

(ot4) 

(04) 

(yA) 

c  <  0 

c  •  0 

c  >  0 

l  <  X  <  u 

i  <  X  <  u 

f  <  x  <  u 

<a3) 

(03) 

(y3) 

c  <  0 

c  *■  0 

c  >  0 

x  -  l 

x  •  t 

x  ■  l 

(<*2) 

(02) 

(y2) 

c  <  0 

c  *  0 

c  >  0 

x  <  l 

x  <  t 

x  <  t 

(al) 

(01) 

(yl) 

Fig.  2 — State  Diagram 


Nciue  chat  states  o4 ,  04,  43 ,  42,  and  y2  are  "in-kilter 
and  that  reversing  an  arc  (reversing  Its  direction,  its 
upper  and  lower  bounds ,  and  changing  the  signs  of  c ,  x , 
u,  and  t)  "reflects"  its  state  through  the  center  box  03. 

The  arcs  in  boxes  a3 ,  a2 ,  al,  01,  and  yl  need  to  have  their 
flows  Increased  to  bring  them  into  kilter  (see  upward  point¬ 
ing  arrows  in  Fig.  3);  and  their  kilter  numbers  are  precisely 


Che  Amount  of  flow  increase  needed  Co  bring  them  into 
kilter,  These  arcs  will  be  called  sub-kilter  arcs. 


Similarly,  the  arcs  in  states  <*5,  05,  y5 ,  y<* ,  and  y3 
must  have  their  flows  decreased  by  an  amount  equal  to 
their  kilter  numbers  in  order  to  bring  them  into  kilter. 
These  arcs  will  be  called  super-kilter  arcs. 


x  >  u 

x  -  u 

l  >  x  >  u 

x  -  t 

X  <  t 

c<0  c-0  c  >  0 


Fig.  3--Flow  Changes  that  Decrease  the  Kilter  Numbers 
(Indicated  by  straight  arrows.  Waved  arrows 
indicate  flow  changes  that  do  not  change  the 
kilter  number.) 


Moreover,  an  arc  in  state  02  or  03  may  increase  its  flow 
at  least  one  unit  without  Increasing  Lts  kilter  number  and 


without  decreasing  its  kilter  number  since  whs  kilter 
number  is  zero.  These  possible  fie  cresses,  together 
with  possible  decreases  for  the  co  mtntary  states,  are 
indicated  by  the  waved  arrows  in  Fig. 

Because  of  the  symmetry  of  the  state  diagram,  a  rulw 
for  increasing  the  flow  in  a  sub-kilter  arc  Ties  its  com¬ 
plementary  rule  in  a  super-kilter  arc.  For  the  sake  of 
brevity,  we  assume  that  the  arcs  are  directed  whichever 
way  is  the  most  convenient  for  the  discussion.  Bear  in 
mind  that  any  arc  may  be  reversed  if  desired. 

LABELING  PROCEDURE 

The  nodes  are  labeled  with  arc  numbers.  Begin  with 
all  node  labels  L(i)  at  zero.  A  node  is  unlabeled  if  its 
label  is  zero  and  it  is  labeled  if  its  label  is  non-zero. 
Find  an  arc  that  is  out-of-kilter,  and  assume  that  it  is 
super-kilter  (its  flow  must  be  decreased) .  This  arc  is 
the  target  arc,  say  arc  J.  Label  its  source  node  S(J] 
with  the  label  J,  i.e.,  set  L(S[JJ)  -  J.  Now  find  any  arc 
j,  where  one  node  is  labeled  and  one  is  not.  Assume  its 
source  node,  i,  is  labeled  and  its  sink  node,  k,  is  not. 

If  the  flow  may  be  increased  without  increasing  the  kilter 
number  of  the  arc,  then  label  the  sink  node  of  this  arc 
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wit  h  the  ere  number;  l.e.,  aet  L(k)  -  j.  Continue  looking 
for  nodee  to  label  until  one  of  two  occurrences: 

1)  The  sink  node  T[J]  of  the  target  arc  la  labeled, 
or 

2)  No  more  nodes  can  be  labeled. 

These  two  possibilities  are  known  respectively  as  1)  break¬ 
through  and  2)  non-breakthrough. 

BREAKTHROUGH 

Since  the  sink  node  of  the  target  arc  was  labeled, 
there  is  a  path  of  arcs  from  the  source  node  of  the  target 
arc  to  the  sink  node  of  the  target  arc,  each  of  which  may 
have  its  flow  increased  without  increasing  its  kilter 
number.  This  path  may  be  traced  backward  from  the  sink 
node  of  the  target  arc  by  means  of  the  labels  on  the  nodes 
to  the  source  node  of  the  target  arc.  Then  calculate  the 
maximum  amount  that  the  flow  can  be  increased  in  the  (non¬ 
target)  arcs  in  the  cycle  (or  decreased  in  the  target  arc) 
without  increasing  the  kilter  numbers  of  any  of  these  arcs . 
Let  this  number  be  c ,  and  make  this  change  in  each  arc  of 
the  cycle.  The  kilter  number  of  the  problem  has  now  de¬ 
creased  by  at  least  as  much  as  the  kilter-number  change 
in  the  target  arc.  The  kilter  numbers  for  arcs  not  in 
the  cycle  are  unchanged,  and  the  kilter  numbers  of  the 
arcs  in  the  cycle  are 
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kj  -  mAx(0,  k^  -  c) 

where  kj  1*  the  old  kilter  number  end  kj  Is  the  new  kilter 
number  for  the  arc  j  in  the  cycle.  Since  we  ere  dealing 
with  integers,  e  is  at  least  1. 

NOW -BREAKTHROUGH 

A  non-breakthrough  occurs  if  no  more  nodes  can  be 
labeled  and  the  sink  node  of  the  target  arc  is  not  labeled. 
The  nodes  are  then  divided  into  two  classes .  labeled  and 
unlabeled.  The  set  of  arcs  that  have  one  node  labeled 
and  one  node  unlabeled  will  be  called  the  cut  set  for  this 
labeling,  since  the  arcs  in  the  cut  set  cut  off  the  set  of 
labeled  nodes  from  the  set  of  unlabeled  nodes.  The  target 
arc  is  a  member  of  this  cut  set.  Suppose  that  all  arcs 
in  the  cut  set  have  their  source  nodes  labeled  and  their 
sink  nodes  unlabeled.  (If  an  arc  is  labeled  conversely, 
we  may  reverse  it  by  the  transformation  mentioned  above 
in  Sec.  I.)  Then  all  of  the  arcs  in  the  cut  set  have  the 
property  that  their  flows  cannot  be  increased  without  in¬ 
creasing  their  kilter  numbers.  As  shown  in  Fig.  3,  these 
arcs  must  be  in  states  o5,  0 5 ,  y5,  oA,  04,  y4,  y3,  or  y2. 
That  is,  the  flow  in  each  arc  is  either  at  or  above  its 
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upper  bound  or  its  reduced  cost  is  positive  and  its  flow 
is  et  or  above  its  lower  bound.  These  states  are  those 
in  Fig.  4  for  which  arrows  point  to  the  left. 

Mote  that  if  the  prices  of  the  nodes  in  the  unlabeled 
set  of  nodes  are  increased  by  any  constant ,  then  only  the 
arcs  in  the  cut  set  will  have  their  reduced  cost  changed, 
and  this  change  in  the  reduced  cost  will  be  precisely  the 
negative  of  the  change  in  node  prices  of  the  unlabeled 
nodes.  The  leftward  pointing  arrows  in  Fig.  4  indicate 
the  direction  of  state  change  that  may  occur  by  decreasing 
the  reduced  cost  of  the  arcs  in  the  cut  set.  Note  that 
the  arrows  point  toward  states  that  have  no  greater  kilter 
numbers  than  they  do  themselves. 

Let  A  be  the  amount  that  the  unlabeled  nodes  are  going 
to  have  their  prices  raised,  i.e.,  the  amount  that  the  re¬ 
duced  costs  of  that  arc  in  the  cut  set  will  be  decreased. 
Denote  by  Case  1  the  situation  that  exists  if  there  are 
any  arcs  in  the  cut  set  which  are  in  states  yZ  or  y3,  i.e., 
with  x  <  u  (shown  shaded  in  Fig.  4) .  Case  2  occurs  when 
all  arcs  in  the  cut  set  have  flows  at  least  equal  to  their 
upper  capacities. 

Consider  first  Case  1.  It  is  clear  that  the  value  of 
A  must  not  exceed  the  value  of  the  reduced  cost  for  any  arc 
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X  >  u 

X  -  u 

X  -  u 

II 

X  -  u 

0 

0 

X  -  t 

l  <  X  <  u 

c 

1 

X 

0 

//x-L/ 

X  -  l 

U  -  X 

0 

SJ  S  * y/j 

X  <  l 

U  -  X 

l  -  X 

t  -  X 

c  <  0 

Ol 

1 

o 

c  >  0 

Fig.  4 --Kilter  Numbers  of  the  Various  States 

(Arrows  show  the  states  which  may  have 
their  reduced  costs  lettered  in  a  non¬ 
breakthrough  cut  set.) 


in  the  cut  set  in  state  y2  or  y3 ,  but  that  the  reduced 
costs  of  arcs  in  the  cut  set  in  other  states  may  be  de¬ 
creased  by  any  amount  without  increasing  their  kilter 
numbers.  Denote  as  the  critical  arc  that  (or  one  of  the) 
arc(s)  in  state  yl  or  y3  with  the  lowest  reduced  cost. 

Let  A  be  the  reduced  cost  of  the  critical  arc  and  increase 
the  node  prices  of  all  unlabeled  nodes  by  A.  If  the 
critical  arc  is  in  state  y2,  its  kilter  number  will  remain 


at  sero. 
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Now  consider  Cate  2.  All  tret  in  the  cut  tet  have 
flowa  at  ieaat  equaling  their  upper  capacities.  Let  the 
critical  arc  be  the  arc  with  the  maximum  reduced  coat. 

If  the  critical  arc  has  a  positive  reduced  cost,  let  A 
be  this  number  and  raise  the  prices  of  the  unlabeled  nodes 
by  A.  This  causes  every  arc  that  had  a  positive  reduced 
cost  to  now  have  a  non-positive  reduced  cost  and  to  have 
its  kilter  number  reduced  from  x  -  l  to  x  -  u.  On  the 
other  hand,  if  the  critical  arc  has  a  non-positive  reduced 
cost,  then  all  arcs  in  the  cut  set  have  a  non-positive 
reduced  cost;  and  the  kilter  number  of  the  terget  arc  can¬ 
not  be  reduced.  Hence,  the  problem  is  infeasible.  The 
cut  set  is  then  a  cut  in  the  classical  sense  in  that  the 
target  arc  has  a  flow  above  its  upper  capacity  and  the  only 
way  to  reduce  the  flow  in  the  target  arc  is  to  increase  the 
flow  in  sene  other  arc(s)  in  the  cut  set  which  has  a  flow 
at  least  equaling  its  upper  capacities.  If  the  flow  in 
the  target  arc  exceeds  its  upper  capacity,  the  problem  is 
infeasible  (in  Case  2)  regardless  of  the  sign  of  the  re¬ 
duced  cost  of  the  critical  arc,  but  some  improvement  of 
the  kilter  numbers  occurs  if  the  reduced  cost  of  the 
critical  arc  is  positive. 


In  Any  event,  for  Ca«e  2,  after  the  node  price*  have 
been  changed,  the  kilter  number  of  the  target  arc  has  been 
minimised  (to  sero  if  its  flow  was  at  the  upper  capacity) 
and  no  more  labeling*  with  this  arc  as  the  target  arc 
should  be  attempted.  In  Case  1,  the  labeling  procedures 
should  now  be  continued,  keeping  the  label*  intact  for  the 
nodes  already  labeled.  At  least  one  more  node  can  be 
labeled,  in  particular,  the  sink  node  of  the  critical  arc. 
Hence ,  since  there  are  m  nodes ,  at  most  m  -  1  consecutive 
Case  1  non-breakthrough*  can  occur  with  the  same  target 
arc.  If  the  problem  is  feasible,  the  kilter  number  for 
the  problem  will  be  decreased  after  at  moat  m  labelings. 
Hence,  it  is  seen  that  the  algorithm  converges. 
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III,  BELATED  ALGORITHMS 

THE  INFEASIBILITY  ALGORITHM 

Fcr  each  arc ,  j ,  of  the  network ,  define  q  ^ ,  the 
Infeealb^ffy 

-  max(0,  xj  "  uj*  4j  “  xj>  » 

end  Q,  the  total  Infeaeibllltvi 
n 

q  ■  l 's  ■ 

J-l 

It  Is  clear  that  Is  the  amount  (if  any)  that  the  flew 
violates  the  upper  or  lower  capacities  Imposed  on  the  arc 
j.  It  is  also  clear  that  the  kilter  number ,  K,  of  the 
problem  can  be  reduced  to  the  value  of  Q.  and  that  if  Q 
is  at  its  minimum  value,  then  K  can  be  reduced  to  its 
minimum  value  (which  is  K  ■  Q)  using  the  out-of-kilter 
algorithm.  If  Q  is  not  at  its  minimum  value,  and  if  the 
problem  is  infeasible,  then  K  may  not  be  reduced  to  its 
minimum  value  by  the  out-of-kilter  algorithm.  For  example, 
the  network  of  Fig.  5  has  initially  zero  flow  in  each  of 
its  three  arcs,  the  upper  capacity  is  equal  to  the  lower 


Fig.  5 --Example  Network  (Numbers  in  parenthesis 
ere  the  lower  end  upper  capacities.) 

capacity  for  each  arc,  and  the  capacity  for  arc  (A,B)  is  1, 
for  arc  (B,C)  is  1,  and  for  arc  (C,A)  is  0.  Arc  (C,A)  is 
"in-kilter,"  while  the  others  are  not;  but  any  change  in 
the  flow  will  cause  arc  (C,A)  to  go  "out-of-kilter,”  hence, 
nothing  can  be  done  to  this  network  by  the  o?:t-of-kllter 
algorithm.  Thus ,  K  remains  at  2 ,  despite  the  fact  that 
the  minimum  K  is  1.  This  minimum  is  obtained  by  forcing 
a  flow  of  1  into  each  arc,  thereby  increasing  the  kilter 
number  (which  in  this  case  is  also  the  lnfaaslbility 
number)  of  arc  (C,A)  to  1  and  decreasing  the  kilter  numbers 
of  the  other  two  arcs  to  zero.  The  attainment  of  the 
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minimum  K  can  also  depend  on  the  order  in  which  ere*  are 
chosen  to  be  brought  into  kileor  and  on  the  order  in  which 
nodes  ere  labeled.  The  network  in  Fig.  6  ia  en  example  in 
which  either  of  these  poasibilitiea  can  occur. 


A  B 


Fig.  6- -Another  Example  of  an  Infeasible  Network 


An  algorithm  will  now  be  developed  to  solve  the  prob¬ 
lem  of  minimizing  Q  for  a  network.  In  order  to  develop 
this  algorithm ,  we  use  the  artifice  of  replacing  each  arc 
of  the  network  by  three  new  arcs.  Suppose  an  arc  has 
source  node  A,  sink  node  B,  lower  capacity  i,  upper 
capacity  u,  and  nominal  flow  x.  The  three  arcs  that  re¬ 
place  this  arc  (see  Fig.  7) ,  each  have  source  node  A  and 
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(-.0) 


B 


Fig.  7--Artificial  Arcs  Used  in  Infesslbility 

Algorithm 


sink  node  B,  «nd  are  denoted  as  arc  >1,  arc  0,  and  arc  +1. 
These  arcs  have  the  following  properties: 


Arc 

arc  -1 
arc  0 
arc  +1 


Unit 

Cost 

c"  -  -1 

c®  »  0 
+ 


Lower  Upper 
Capacity  Capacity 


4°  «  4 

-  +1  4+  -  0 


u 


0 

u 


u+  -  +« 


Flow 

x“  -  min(0,  x  -  4) 
x°  -  max (4,  min(u,x)) 
x+  •  ntax(0 1  x  -  u) 


Note  that  x  »  x"  +  x®  +  x+,  and  that  the  flows  are 
feasible  in  each  arc.  Hence,  this  new  problem  is  feasible 
and  its  total  cost  is  precisely  Q  of  the  original  problem. 
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Let  y“ ,  y,  end  y+  be  the  reduced  costs  for  arcs  -1,  0,  and 
+L ,  respectively,  so  that 

Y~  *  *l  +  fA  '  #B  “  7  “  1 

7  “  0  +  ffA  -  *B 
y+  -  +1  +  #A  -  irB  -  y  +  i  . 

It  is  not  necessary  to  deal  with  node  prices  for  this  algo¬ 
rithm,  but  only  with  the  reduced  costs  y,  which  for  each 
arc  are  initially  zero.  Hence  y"  ■  -1  and  y+  -  +1  initially, 
y  must  remain  non-negative,  since  it  could  become  negative 
only  if  the  flow  in  arc  +1  were  at  its  upper  bound,  which 
would  imply  that  Q  is  Infinite.  Similar lyj  y~  must  remain 
non-positive.  Thus, 

y*  ■  y  •  1  <  0 
y+  ■  y  +  1  *  0, 


or 


y  *  1 


y  *  -1  , 
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i.e. ,  | y j  *  1.  But  y  will  take  on  only  integral  values; 
hence,  y  may  only  be  0  or  ±1.  Arc  -1  will  have  non-zero 
(negative)  flow  only  if  x  <  i,  and  its  flow  may  be  decreased 
(made  more  negative)  only  if  y“  0,  i.e.  ,  (since  y“  must  be 
non-positive)  y*  ■  0  or  y  ■  1.  Similarly,  the  flow  may  be 
increased  in  arc  +1  only  if  y  -  -1;  and  arc  +1  will  have 
non-zero  flow  only  if  x  >  u. 

The  above  discussion  shows  that  if  node  A  is  labeled 
then  node  B  can  be  labeled: 

1)  via  arc  -1  if  x  <  i; 

2)  via  arc  0  if  x  <  u  and  y  +  1; 

3)  via  arc  +1  if  y  -  -1. 

The  state  diagram  of  this  composite  arc  is  shown  in 
Fig.  ft.  Mote  that  the  states  that  are  Impossible  for  y  j*  0 
are  crossed  out.  If  a  non-breakthrough  occurs,  then  for  each 
composite  arc  that  has  *ts  source  node  labeled  and  its  sink 
node  unlabeled,  either  [y  •  0  and  x  *  u)  or  {y  ■  +1  and 
x  -  l) .  Increasing  the  node  prices  (which  are  not  being 
computed)  of  the  unlabeled  nodes  by  +1  is  equivalent  to 
decreasing  y  of  this  composite  arc  by  1  (or  increasing 
y  by  1  if  the  arc  is  labeled  conversely) .  This  moves 
the  state  of  the  arc  one  box  to  the  left,  and  hence  to 
a  labelable  state  (unless  x  *  l  *  u) .  Moreover,  this 
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x  >  u 

X  -  u 

t  <  X  <  u 

X  •  t 

X  <  l 


Fig.  8- -Arc  States  In  which  Flow  may  be  Increased 
in  the  Infeasibility  Algorithm 

change  of  the  y’s  puts  the  target  arc  into  kilter ,  since 
a  composite  arc  is  in  kilter  if  either  y  +  0  or  l  s  x  s  u. 

Hence,  the  problem  of  minimizing  Q  may  be  solved  by 
the  out-of-kilter  algorithm  by  replacing  each  arc  by  three 
area  with  appropriate  bounds  and  costs.  But  these  com¬ 
posite  arcs  were  merely  an  artifice  used  for  determining 
a  new  algorithm  based  on  the  out-o£-kilter  method.  Now, 
discarding  the  composite  arcs,  this  method  may  be 


summarized. 


40- 
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Begin  with  numbers  y^,y 2> *••»*„  *11  *ero.  Look  for 
an  ere,  J,  with  yj  «  0*  end  either  Xj  >  u^  or  x^  <  4j. 

If  no  such  ere  exists,  Q  hes  been  minimized  end  we  ere  done. 
When  en  art  is  found  with  these  properties,  label  Its  source 
node  if  Xj  >  Uj  end  its  sink  node  if  Xj  <  lj.  Then  begin 
a  labeling  procedure  that  terminates  if  the  other  node  of 
arc  J  is  labeled  or  if  no  more  nodes  can  be  labeled. 

If  arc  j  has  its  source  node  labeled  and  its  sink 
node  unlabeled,  the  sink  node  can  be  labeled  if 

1)  y^  ■  0  and  Xj  <  u j  * 
or 

2)  /j  -  -l, 

or  • 

3)  Xj  <  ly 

If  the  sink  node  is  labeled  and  the  source  node  unlabeled, 
the  source  node  can  be  labeled  if 

1)  y^  ■  0  and  x^  >  t  ^ , 
or 

2)  rj  -  «. 

or 


3) 
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When  the  labeling  procedure  results  in  a  breakthrough 
(i.e.,  both  nodes  of  arc  J  have  been  labeled),  the  cycle 
is  determined,  and  c  is  calculated  and  added  to  those  arcs 
labeled  (forward)  from  source  to  sink  and  subtracted  from 


those  arcs  labeled  (backward)  from  sink  to  source.  (  is 
the  minimum  of 

1)  u j  “  x j  if  “  0  and  arc  j  labeled  forward, 

2)  Xj  -  if  »  0  and  arc  j  labeled  backward, 

3)  i.  -  x  if  y  -  +1  and  arc  j  labeled  forward, 


'  ^  "j 

4)  x^  -  Uj  if  y  ^  ■  -1  and  a*"'  j  labeled  backward 
for  all  arcs  in  the  cycle.  If  an  arc,  j,  is  labeled  for¬ 
ward  and  y ^  «  -1  or  labeled  backward  and  y ^  m  +1,  then 
this  arc  imposes  no  limit  on  c.  All  arcs  with  y ^  -  0  do 
impose  a  limit,  and  arc  J  Is  one  of  these.  After  the  e 
change  in  the  cycle,  Xj  may  or  may  not  satisfy  Xj  *  ij 
and  Xj  s  uT.  If  it  does  satisfy  these  conditions,  then 
look  for  another  arc  to  label.  If  it  does  not  satisfy 
these  conditions ,  begin  the  labeling  procedure  anew  with 
arc  J. 


When  the  labeling  procedure  results  in  a  non-break- 
through,  subtract  1  from  y ^  of  ail  arcs  with  the  source 
node  labeled  and  the  sink  node  unlabeled,  and  add  1  to  y ^ 
for  all  arcs  with  the  source  node  unlabeled  and  the  sink 
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node  labeled.  The  other  arcs  do  not  have  a  change  made 
in  In  particular,  arc  J  has  one  node  labeled  and 

one  unlabeled;  hence ,  now  y j  ■  ±1.  Thus,  another  arc  oust 
be  found  to  begin  the  labeling  procedure  again. 

Eventually,  every  arc  will  have  either  y^  j*  0  or 
<  Xj  a  u j .  The  infeasibility  of  the  flow  has  then  been 
minimised.  If  y^  +  0 ,  arc  j  is  not  necessarily  infeasible, 
but  all  arcs  with  non-zero  y  can  be  thought  of  as  part  of 
a  cut  set  for  all  of  the  infeasible  arcs. 

THE  FEASIBILITY  ALGORITHM 

The  feasibility  algorithm  is  similar  to  the  infeasi¬ 
bility  algorithm,  except  that  one  is  not  interested  in 
minimizing  the  infeasibility  but  only  in  finding  a  feasible 
flow  if  it  exists.  If  the  problem  is  feasible,  no  non¬ 
breakthroughs  will  occur  in  the  infeasibility  algorithm. 
Hence,  the  reduced  costs,  y,  will  never  be  made  non-zero. 

The  labeling  procedure  for  the  feasibility  algorithm 
is  as  follows.  If  the  source  node  of  arc  j  is  labeled  and 
the  sink  node  is  unlabeled,  then  the  sink  node  can  be 
labeled  if  Xj  <  uj  *  the  sink  node  is  labeled  and  the 
source  node  is  unlabeled,  then  the  source  node  can  be 
labeled  if  x^  >  ly  Only  arcs  which  are  infeasible  are 
chosen  as  target  arcs.  If  a  non-breakthrough  occurs,  the 
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problem  la  infeasible.  Otherwise,  only  breakthroughs  will 
occur,  and  the  problem  will  be  feasible  when  all  arcs  are 
made  feasible.  For  this  algor itte,  no  are  calculated. 
Hence,  it  Is  simpler  computationally  than  the  infeasibility 
algorithm. 

TWO" PHASE  ALGORITHMS 

Either  the  infeasibility  algorithm  or  the  feasibility 
algorithm  may  be  used  as  the  first  phase  of  a  two-phase 
algorithm.  Then  the  second  phase  Is  the  out-of-kilter 
algorithm  described  in  Sec.  II.  If  phase  1  causes  the 
network  to  be  feasible,  certain  tests  in  the  out-of-kilter 
algorithm  become  unnecessary.  In  the  labeling  procedure, 

If  the  source  node  of  arc  j  is  labeled  and  the  sink  node 
d*  un labeled,  the  sink  node  can  be  labeled  if  <  0  and 
Xj  <  u j .  The  additional  case,  that  x^  <  and  >  0, 
cannot  occur  in  this  algorithm  and  need  not  be  tested. 
Similarly,  in  the  non-breakthrough  procedure,  the  tests 
for  x  >  u  can  be  omitted. 
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IV,  COMPUTATIONAL  METHODS 


LABELING 

The  method  of  labeling  nodes  described  in  Sec.  II 
was  that  of  looking  for  an  arc  with  one  node  labeled  and 
one  node  unlabeled  and  than  determining  whether  the  un¬ 
labeled  node  could  be  labeled.  A  method  has  evolved  that 
requires  less  searching  for  arcs  with  exactly  one  node 
labeled.  The  idea  of  this  method  is  to  set  up  what  is 
called  a  scan  list.  Associated  with  the  scan  list  are 
two  Indices:  s,  the  length  of  the  scan  list,  and  p,  the 
position  of  the  scanner.  Denote  the  scan  list  itself  by 

R(l) ,R(2) . R(s) .  The  procedure  begins  with  p  -  1, 

s*l,  and  R(l)  “  node  which  is  the  labeling  origin.  Then 
look  at  (i.e.,  scan)  each  arc  for  which  the  node  R(p)  is 
its  source  node  or  its  sink  node.  If  the  other  node  of 
any  of  these  arcs  can  be  labeled,  do  so,  increase  s  by  1 
and  set  R(s)  to  the  node  just  labeled.  If  R(s)  is  the 
terminal  node,  then  the  labeling  procedure  is  done  and  a 
breakthrough  has  occurred.  When  all  of  the  arcs  joining 
node  R(p)  have  been  scanned  and  no  breakthrough  has  occurred, 
increase  p  by  1,  then  repeat  the  process  for  the  new  node 
R(p).  If  p  >  s,  then  the  scan  list  has  been  exhausted 
and  a  non-breakthrough  has  occurred. 
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When  this  procedure  is  used,  esch  ere  can  be  "looked 
•t"  at  most  twice:  once  from  each  of  its  nodes.  But,  in 
order  for  this  method  to  be  more  efficient  than  one  that 
merely  searches  for  arcs  with  one  node  labeled,  lists  must 
be  set  up  of  the  arcs  that  join  each  particular  node. 

LIST  STRUCTURE 

Let  there  be  n  arcs  such  that  the  arc  has  source 
node  S[j]  and  sink  node  T[j]«  Suppose  that  there  are  m 
nodes  numbered  from  1  through  m  and,  therefore,  that  S  and 
T  have  values  in  this  range.  Assuming  that  the  arcs  are 
in  no  particular  order,  it  is  necessary  to  set  up  four 
lists ,  say  U,  V,  g,  and  h,  where  U  and  V  are  arrays  of 
length  nrt-1  and  g  and  h  are  of  length  n.  Let  be  the 

number  of  arcs  that  have  node  i  as  their  source  node  and 
let  be  the  number  of  arcs  that  have  node  i  as  their 
sink  node.  Either  cr^  or  r^,  but  not  both,  may  be  zero. 
Then  U  and  V  are  defined  recursively: 


Ui+1  "  Ui  +  °i  i“l >2 , . . . ,m 


and 


How,  let  for  1*1, 2,..., m.  For  each  J  from  1 

through  n,  let  i  •  S[j],  gCp^]  •  j,  and  then  increase  pi 
by  1.  When  this  is  done,  g[U^]  through  gtU^^  -1]  is  a 
list  of  the  arcs  with  node  i  as  the  source  node.  The 
same  procedure  is  repeated  for  V  and  h  with  the  sink  nodes , 
giving  a  list  of  the  arcs  with  the  same  sink  node. 

The  ALGOL  procedure  in  the  Appendix  uses  the  above 
lists.  This  procedure  executes  the  out-of-kilter  algorithm 
as  described  in  Sec.  II.  This  may  be  compared  with  the 
simpler  program  in  Ref.  4.  The  symbols  used  in  this  pro¬ 
gram  are  substantially  the  same  as  the  ones  given  at  the 
beginning  (p.  xi)  and  used  throughout  this  Memorandum. 

Space  may  be  saved  by  arranging  the  arcs  so  that  the 
source  nodes  are  in  order.  Then  the  list  g  is  unnecessary 
since  g(j)  -  j.  This  procedure  is  used  in  the  FORTRAN 
program  of  Ref.  5. 

More  complicated  list  structures  may  be  needed  if 
this  procedure  must  store  data  on  such  peripheral  devices 
as  disks.  In  this  event,  it  may  be  useful  to  double  each 
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arc  so  that  it  h as  it 9  forward  and  backward  representa¬ 
tions  In  the  lists.  Then  only  one  "disk  file0  need  be 
retrieved  for  scanning  each  node. 

TENTATIVE  CONCLUSIONS 

Several  experiments  were  done  with  the  methods  de¬ 
scribed  above.  Since  these  experiments  were  not  at  all 
extensive,  and  since  the  results  depend  greatly  on  the 
type  of  problem  and  machine  software,  these  conclusions 
should  not  be  regarded  as  final. 

Several  problems  were  solved  using  the  algorithm 
described  in  Ref.  4  and  the  algorithm  given  in  the  Appendix. 
The  largest  problem  solved  had  1530  arcs.  This  problem 
was  run  on  a  relatively  slow  machine  (IBM  360  Model  40) 
with  the  result  that  the  program  with  the  list  structure 
described  above  ran  five  times  as  fast  as  the  program  with¬ 
out  this  list  structure  (30  min  vs.  2.5  hr).  This  time 
ratio  should  increase  on  larger  problems  and  decrease  on 
smaller  problems.  The  faster  problem  solution  using  the 
program  with  the  list  structure  must  be  balanced  against 
the  greater  storage  capacity  needed  for  the  lists. 

Several  teats  were  made  employing  a  two-phase  algo¬ 
rithm,  with  the  first  phase  being  the  feasibility  algorithm 
described  in  Sec.  III.  This  modification  increased  the 
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number  of  calculations ,  and  hence  cannot  be  recommended. 
In  fact,  Fulkerson 4 s  [3]  original  description  of  the 
algorithm  seems  to  be  the  most  efficient,  even  though 
certain  Case  2  non-breakthrough  calculations  were  not 
made.  Therefore,  some  of  these  calculations  are  not 
included  in  the  appended  ALGOL  procedure. 
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Appendix 
ALGOL  PROCEDURE 

This  ALGOL  procedure  should  be  Beif-explanatory  since 
it  uses  the  symbols  appearing  in  the  body  of  this  Meso- 
randura.  Upper  and  lower  case  symbols  are  distinct.  The 
symbol  "pi"  corresponds  to  the  symbol  it  in  the  text,  "out- 
kilter"  is  the  number  of  arcs  that  could  not  be  brought 
into  kilter  by  the  procedure,  and  "refnode"  is  an  arbitrary 
node  whose  w  value  is  not  changed  by  the  procedure.  This 
procedure  was  not  checked  in  the  ALGOL  language;  hence, 
all  errors  may  not  have  been  detected. 

Procedure  network  (m,n ,S ,T ,c ,u ft ,x , pi .refnode ,outkilter) 
integer  m,n,refnode .outkilter ; 
integer  array  S  ,T  ,c  ,u  ,-t  ,x  ,pi ; 

begin  integer  array  U,V[ 1 :m+2 ] ,g,h[ t :n 1 ,L,R[1 :m1; 
integer  J , aa,term,laborg, origin ,i , j ,p,k,s ,a,kp,Kq ,eps , epsl ; 
Boolean  breakthru; 
outkilter:-  0; 
go  to  setup; 

endsetup:  for  j:-  1  step  1  until  n  do 
c (j)  :**  c(J)4T>i<S[jl)-pi(Tr.j  1)  ; 
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cotaroent  look  for  an  out-of-kilter  arc; 
search:  J:-  1;  as:-  0;  breokthru:-  true : 
mainlp:  if  x(J)«,(J) vc(J)<OAx(J)<u(J)  then  go  to  fd; 

if  x ( J) >u(J) vc (J) >0 ax (J) >l (J)  then  go  to  bd; 
return:  J:-  J+l; 

if  J*n  then  go  to  mainlp; 
for  j :-  1  step  1  until  n  do 
c(j)  :-  c(j)-pi(S[j  ])+pi(T[ j  ])  |  fio  to  endn ; 
fd:  term:-  S[J1;  origin:-  T[J];  laborg:-  J; 
go  to  preleb; 

bd:  term:-  TC J 1 ;  origin:-  S[J1;  laborg:-  -J; 
prelab:  R(l):-  origin;  £o  to  label; 

comment  count  arcs  beginning  and  ending  at  nodes; 
setup:  for  i:-  3  step  1  until  m  +  2  do 
begin  U(i):«  0;  V(i):«  0  end: 
for  j:-  1  step  1  until  n  do 

begin  U(S[j]  +  2):-  U(S[j]  +  2)  +  1; 

V(T[ j ]  +  2):-  V (T[ j ]  +  2)  +  1  end: 
comment  cumulate  counts; 

U(l) :-  1;  U(2) :-  1; 

V(l) :-  1;  V(2) :-  i; 
for  i:-  3  step  1  until  m  +  1  do 
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begin 

U(i):«  U(i)  +  U(i-l); 

V(i) V(i)  +  V(i-l)  end; 

comae  nt 

set  up  arc  locator  lists; 

for  it- 

1  step  1  until  n  do 

begin 

g£U(Stj]  +  1)}:-  j; 

h[V(T[  j  ]  +  1)3:-  j; 

U(S[J1  +  1):-  U(SCJ]  +  1)  +  1; 

V(T[J  ]  +  1):-  V (T[ j  ]  +  1)  +  1 

end ; 

go  to  endsetup; 

label:  if  -ibreakthruM-aa  then  go  to  label2; 
comment  zero  out  labels; 
for  !:■  1  step  1  until  n  do  L(i) :  ■  0; 
s:-  1; 

label2:  p:«  1;  aa:-  J;  breakthru:-  false;  L(origin) :«  laborg 
comment  try  to  label  the  forward  arcs; 
label3 :  i :-  R(p) ; 

for  a:-  U(i)  step  1  until  U(i+1)-1  do  begin 
J:-  gU];  k:«  T[j3; 

if  L(k) "0 a[ x  (  j  )  <t  ( j  )  vc  ( j  )  sO  Ax  ( j  )  <u  ( j  )  1  then 
begin  L(k) :«  j;  s:«  s+1;  R(s):*  k  end;  end ; 


comment  try  to  label  the  backward  arcs; 
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for  a:«  V(i)  step  1  until  V(i+1)-1  do  begin 

j :«  hf  a1 ;  k:«  S[j 1; 

if  L(k)-0A[x(j)>u(j)vc(j)20Ax(j)>>?.(j)  ]  then 
begin  L(k):-  -  j ;  s:-  s+1;  R(s):«  k  end:  end; 
comment  test  for  terminal  labeled; 
if  L(term)fO  then  go  to  break; 

p:-  p+1; 

comment  if  scan  list  exhausted,  non-breakthru; 

if  p>s  then  go  to  nobreak; 
go  to  label3; 

comment  find  flow  increment  in  cycle; 
break:  eps:-  999999999;  breakthru:-  true; 

Kt:«  term; 

j:-  1 

breakloop:  Kq:“  L(Kt) ;  kp:“  abs(Kq); 

if  Kq>0  then  go  to  forwardbreak;  Kt:«  T(kp); 
if  c(kp)^0  then  go  to  lowerbreak; 
go  to  upperbreak; 
forwardbreak:  Kt:»  S[kp] 

if  c(kp)>0  then  go  to  lowerbreak; 
upperbreak:  eps:»  min(eps ,abs (u(V  O-x(kp)))  ; 


go  to  endbreakloop; 


lowtsrbreak:  ops:*5  min '(eps  ,abs  (' (kp) -x  (kp) )  )  ; 

endbreakloop:  R(j):*  Kq; 

if  Kt  *  term  then  go  to  increment; 
j:-  j+1;  £0  to  break loop; 
comment  increment  clow; 
increment:  for  i:-  1  step  1  tint  11  j  do 
if  R(i) >0  then 
x(R(i)):-  x(R(i>)  +  eps 

else  x(-R(i)):»  x(-R(i))  -  eps; 
go  to  mainlp; 

comment  find  delta  for  non-breakthru; 
nobreak:  epsl:-  999999999 ; 

for  j :«  1  step  1  antil  n  do 
if  L(SC  j  ])  j*0AL(T[  j  1)*0ax( 

vL(S[j  ])-0AL(TCj  ])f*0AX(j)>t(j) 
then  epsl:-  min(eps  ,abs  (c  (j  )  )  )  ; 
comment  test  for  case  2; 
eps:»  epsl; 

if  eps^999999999  then  go  to  change; 
if  c(J)-Ovsign(L(origin))-sign(c (J)) 
then  go  to  infeas; 


eps:-  abs(c(J)) ; 
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cocanent  change  reduced  costs; 
change;  for  j  :•  1  step  1  until  n  do 
if  L(S[j!)-OAL(T[J])fK> 

then  c(J):*  c(J)  +  eps  else 
if  L(S[j])^0AL(T[J])-0 
then  c(j)  j-  c(j)  -  eps; 
comment  change  node  prices; 
if  L(re£node)fO  then 

for  !:*■  1  step  1  until  m  do  begin 

if  L(i)«0  then  pi(i) :■  pi(i)  +  eps  end  else 
for  i;«  1  step  1  until  m  do 

if  L(i)f*0  then  pi(i):“  pi(i)  -  eps; 
if  eps«epslvx(J)*£(J) vx(J)«u(J)  then 
go  to  main  loop; 


infeas:  outkilter:-  outkilter  +  1;  go  to  return; 
endn:  end  network 


REFERENCES 


Ford,  L.  R. ,  and  D.  R,  Fulkerson,  Flows  in  Networks. 
Princeton  University  Press,  1962. 

Dantzig,  G.  B.,  Linear  Progratnnln^  and  Extensions. 
Princeton  University  Press,  1963. 

Fulkerson,  D.  R. ,  "An  Out-of-Kilter  Method  for 

Minimum  Cost  Flow  Problems,"  Journal  SIAM.  Voi.  9, 
No.  1  (March  1961),  pp;  18-27. 

Briggs,  W,  A.,  "Netflow,"  Comm.  ACM.  Voi.  8,  No.  2, 
(February  1965),  p.  103. 

"Out  of  Kilter  Network  Routine,"  SHARE  Distribution 
3536,  SHARE  Distribution  Agency,  Hawthorne,  New 
York,  1967. 


DOCUMENT  CONTROL  DATA 
r 


Jb£T»*iIw 


THE  RAND  CORPORATION 


tr«  fpqwT  mamrr  CLMtimcrnoH 
imcussiPitD 


ItMUr 


i  Rt*ORT  TlTLl 

THE  NUMERICAL  SOLUTION  OF  NETWORK  PROBLEMS  USING  THE  OUT-OP -KILTER  ALGORITHM 


4  AUTMOR(S)  ii-atl  name,  tirt  nami,iMitai) 
Clisen.  R.  J. 


5  REPORT  OATC 

March  1968 


•*  TOTAL  W*  OP  Htlt 


6? 


ran*,  or  wn 


7  CONTRACT  OR  GRANT  Ha. 

F44620-67-C-0045 


A  OmOINATOR’R  RfPORT  N*. 

fW-5456-PR 


So  AVAILABILITY  /  LIMITATION  NOTICE* 


nnc-i 


•A  aPOMOMNO  AM  ACT 

United  States  Air  Force 
Project  Rand 


10.  ABSTRACT 

An  explanation  of  the  Fulkerson  network 
flow  algorithm  (P-lfl?5)  to  provide  practi¬ 
cal  guidance  in  applying  it  to  coaputa- 
tlonal  problems.  The  Memorandum  la 
divided  Into  four  substantially  lndapand- 
ent  sections  that  (l)  review  the  types  of 
problems  that  art  rapraaantable  as  capaci¬ 
tated  netvork  problems;  (2)  explain  (with 
diagrams)  the  out-of-kllter  algorithm  and 
tC-ckS-iquCA  far  iaplsasntlr.M  U  uu  t  com¬ 
puter;  (3)  describe  Modification  to  a  two- 
phase  algorithm;  and  (1*)  present  a  aathod 
for  labeling  the  nodes  by  aaans  of  a  scan 
lit*.  it  is  tentatively  concluded  that 
the  two-phase  algoritha  Is  undesirable  and 
that  the  Hat  structure  procedure  shortens 
coaputer  tlae  at  the  cost  of  using  acre 
memory.  A  1530-arc  problem  on  the  IBM-360 
Model  1*0  ran  five  tlaes  as  fast  using  the 
list  • true  lures-- 30  minutes,  as  compared 
with  2.5  hours  for  the  searching  technique. 
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